Redundant Information Neural Estimation

نویسندگان

چکیده

We introduce the Redundant Information Neural Estimator (RINE), a method that allows efficient estimation for component of information about target variable is common to set sources, known as “redundant information”. show existing definitions redundant can be recast in terms an optimization over family functions. In contrast previous decompositions, which only evaluated discrete variables small alphabets, we optimizing functions enables approximation high-dimensional and continuous predictors. demonstrate this on image classification motor-neuroscience tasks.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning efficiency of redundant neural networks in Bayesian estimation

This paper proves that the Bayesian stochastic complexity of a layered neural network is asymptotically smaller than that of a regular statistical model if it contains the true distribution. We consider a case when a three-layer perceptron with M input units, H hidden units and N output units is trained to estimate the true distribution represented by the model with H(0) hidden units and prove ...

متن کامل

Generic Estimation Procedures for Orientation with Minimum and Redundant Information

1 Motivation Orientation of cameras with minimum and redundant information is the rst step in 3D-scene analysis. Compared to image interpretation it looks simple, it seems to be solved in photogrammetry and is expected to be implemented within a few weeks. All experience shows that camera calibration and orientation needs much eeort and the solutions provided in photogrammetric textbooks cannot...

متن کامل

Mine: Mutual Information Neural Estimation

We argue that the estimation of the mutual information between high dimensional continuous random variables is achievable by gradient descent over neural networks. This paper presents a Mutual Information Neural Estimator (MINE) that is linearly scalable in dimensionality as well as in sample size. MINE is backpropable and we prove that it is strongly consistent. We illustrate a handful of appl...

متن کامل

Hammerstein-Wiener Model: A New Approach to the Estimation of Formal Neural Information

 A new approach is introduced to estimate the formal information of neurons. Formal Information, mainly discusses about the aspects of the response that is related to the stimulus. Estimation is based on introducing a mathematical nonlinear model with Hammerstein-Wiener system estimator. This method of system identification consists of three blocks to completely describe the nonlinearity of inp...

متن کامل

Processing Redundant Information

When stimuli differed on two dimensions (size and brightness), either of which could furnish sufficient information for a correct response, reaction times were faster than when stimuli differed on only one dimension. This result holds true even when individual differences in dimension preferences are taken into account. A model of parallel processing of the different dimensions is proposed and ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Entropy

سال: 2021

ISSN: ['1099-4300']

DOI: https://doi.org/10.3390/e23070922